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Abstract 

Multi-constrained  path  (MCP)  selection,  in  which  the 
key  objective  is  to  search  for  feasible  paths  satisfying  multi¬ 
ple  routing  constraints  simultaneously,  is  known  to  be  an 
NP-Complete  problem.  Multi-constrained  path  optimiza¬ 
tion  (MCPO)  is  different  from  MCP  mainly  in  that,  the  fea¬ 
sible  paths  selected  should  also  be  optimal  with  regard  to 
an  optimization  metric,  which  makes  path  computation  in 
MCPO  even  harder. 

We  propose  a  fully  distributed  multi-constrained  path 
optimization  routing  (MPOR)  protocol  that  solves  the  gen¬ 
eral  k-constrained  path  selection  and  routing  optimization 
problems.  MPOR  computes  paths  using  distance  vectors 
exchanged  only  amongst  neighboring  nodes  and  does  not 
require  the  maintenance  of  global  network  state  about  the 
topology  or  resources;  supports  hop-by-hop,  connectionless 
routing  of  data  packets,  and  implements  constrained  path 
optimization  by  distributively  constructing  an  x-optimal 
path  set  (i.e.,  the  shortest,  the  second  shortest  and  up  to 
the  xth  shortest  path  in  terms  of  the  optimization  metric ) 
for  each  destination  at  each  node.  Simulations  show  that 
MPOR  has  satisfactory  routing  success  ratios  for  multi- 
constrained  path  selection,  and  performs  consistently  with 
varying  number  of  constraints.  For  constrained  path  opti¬ 
mization,  MPOR  has  high  probabilities  of  finding  feasible 
paths  that  are  also  optimal  or  near-optimal  for  the  given 
optimization  metric. 
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1  Introduction 

A  central  problem  in  QoS  routing  consists  of  finding 
feasible  paths  that  satisfy  multiple  performance  oriented 
constraints  (e.g.,  bandwidth,  end-to-end  delay  and  jitter) 
between  a  source  and  a  destination.  In  some  scenarios, 
these  feasible  paths  must  also  be  optimized  with  regard  to 
(w.r.t.)  a  given  optimization  metric  (e.g.,  hop-constrained 
widest-path  routing,  delay-constrained  least-cost  path  rout¬ 
ing).  The  first  problem  is  known  as  the  NP-hard  multi- 
constrained  path  (MCP)  selection  problem,  and  the  second 
is  called  the  multi-constrained  path  optimization  (MCPO) 
problem.  Many  heuristic  algorithms  have  been  proposed  to 
solve  each  problem.  However,  only  a  few  approaches  ad¬ 
dress  both  problems  simultaneously,  especially  for  the  gen¬ 
eral  /c-con strained  path  optimization  problem. 

To  date,  most  existing  constrained  routing  algorithms 
deal  with  routing  subject  to  two  constraints,  or  its  opti¬ 
mization  case-the  restricted  shortest  path  (RSP)  problem, 
in  which  the  task  is  to  seek  paths  that  satisfy  one  constraint 
while  optimizing  another  metric.  Such  MCP  and  RSP  prob¬ 
lems  are  not  strong  NP-complete,  in  that  there  are  pseudo¬ 
polynomial  running  time  algorithms  to  solve  them  exactly, 
and  the  computational  complexity  depends  on  the  values  of 
link  weight  in  addition  to  the  network  size  [5],  However, 
their  complexity  is  prohibitively  high  when  the  values  of 
link  weight  become  large. 

Based  on  the  latter  observation  above,  Chen  and  Nahrst- 
edt  [1]  proposed  to  scale  one  component  of  the  link  weight 
down  to  an  integer  that  is  less  than  where  x  is  a 

pre-defined  integer  and  c,-  is  the  corresponding  constraint 
on  weight  component  w*.  They  prove  that  the  problem  af¬ 
ter  weight  scaling  is  poly  normally  solvable  by  an  extended 
version  of  Dijkstra’s  (or  Bellman-Ford)  algorithm,  and  any 
solution  to  the  latter  is  also  a  solution  to  the  original  MCP 
problem.  The  running  time  is  0(x2N2)  when  the  extended 
Dijkstra’s  algorithm  is  used;  and  it  is  O(xEN)  when  the 
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extended  Bellman-Ford  algorithm  is  used,  where  E  and  N 
are  the  number  of  links  and  nodes,  respectively.  However, 
as  shown  in  [7],  satisfactory  performance  is  achievable  only 
when  parameter  x  is  large  enough  (e.g.,  x  =  10),  which 
incurs  considerable  computation  complexity. 

Another  commonly  used  scheme  for  MCP  is  to  define  a 
good  link-cost  (or  path-weight)  aggregation  function  based 
on  the  routing  metrics  and  the  given  constraints.  Then 
any  shortest  path  algorithm  can  be  used  to  compute  the 
shortest  path  w.r.t.  the  single  aggregated  metric.  Jaffe  [5] 
was  the  first  to  use  a  linear  link-cost  function  w(u,v)  = 
awi  (u,v)  +  Bw-2  (it,  v),  in  which  a,/3  £  Z+.  Ever  since, 
both  linear  and  non-linear  aggregation  functions  have  been 
proposed.  The  major  limitation  of  this  approach  is  that  the 
ability  to  find  feasible  paths  based  on  an  aggregated  metric 
largely  depends  on  the  quality  of  the  functions  being  used, 
and  most  of  them  are  empirical  heuristics.  Consequently, 
the  shortest  path  computed  w.r.t.  the  single  aggregated  met¬ 
ric  may  not  simultaneously  satisfy  the  multiple  constraints 
being  considered. 

The  general  fe-constrained  path  computation  has  re¬ 
ceived  far  less  attention  than  the  2-constrained  MCP  or  RSP. 
Yuan  [14]  generalized  the  ideas  of  link- weight  scaling  as  the 
limited-granularity  (LG)  heuristic,  and  also  proposed  the 
limited-path  (LP)  heuristic  in  which  x  non-dominated  paths 
are  maintained  at  each  node.  Then  an  extended  Bellman- 
Ford  algorithm  is  used  to  work  with  one  of  them  to  solve 
the  general  fc-constrained  MCP  problem.  The  running  time 
of  Yuan’s  algorithm  is  |Aj  ■  NE,  where  |Jf|  is  the  size  of 
the  table  to  use,  for  LG;  and  it  is  x2NE ,  where  x  is  the 
number  of  path  to  maintain,  for  LP.  The  performance  and 
complexity  of  Yuan’s  heuristics  depend  on  the  number  of 
possible  values  to  which  link  weight  can  be  scaled  down,  or 
the  number  of  paths  to  maintain  at  each  node.  For  Yuan’s 
algorithms  to  work  correctly,  global  network  state  has  to  be 
available  to  nodes  that  perform  the  path  computation. 

The  implementation  strategies  for  QoS  routing  can  be 
classified  into  centralized  source  routing  and  distributed 
routing.  Most  constrained  routing  algorithms  proposed  to 
date  use  centralized  approaches,  i.e.,  they  compute  feasible 
paths  at  each  source,  and  simply  assume  the  availability  of 
global  network  state  whenever  they  are  needed.  Central¬ 
ized  MCP  algorithms  suffer  from  high  computation  com¬ 
plexity  at  the  source  nodes,  sluggish  response  to  network 
changes,  and  excessive  overhead  caused  by  disseminating 
topology  and  resource  information  throughout  the  network, 
which  significantly  limit  their  scalability.  Due  to  the  use  of 
source  routing,  a  complete  feasible  path  towards  the  des¬ 
tination  usually  needs  to  be  established  before  actual  data 
are  sent  out  (i.e.,  connection  oriented),  or  appended  to  the 
header  of  every  data  packet,  which  may  increase  the  packet 
delivery  delay  and  consume  large  fraction  of  the  bandwidth 
when  the  paths  being  used  are  long. 


Distributed  MCP  algorithms  compute  feasible  paths  lo¬ 
cally  at  each  node,  and  forward  packets  based  only  on  their 
destination  addresses  on  a  hop-by-hop  basis.  Distributed 
routing  is  more  responsive,  robust  and  scalable  than  cen¬ 
tralized  schemes  mainly  in  that,  nodes  independently  make 
routing  decision  and  therefore  are  able  to  respond  to  net¬ 
work  dynamics  quickly. 

Mieghem  et  al  proposed  a  hop-by-hop  destination  based 
only  (HbHDBO)  QoS  routing  algorithm  [9]  Based  on  TAM- 
CRA  [10]  and  its  exact  modification  SAMCRA.  HbHDBO 
has  the  worst  case  complexity  0(kNlog(kN )  +  k2CE ), 
where  k  is  the  number  of  non-dominated  paths  maintained 
at  each  node  and  C  is  the  number  of  constraints  being  con¬ 
cerned  with.  A  node  that  runs  HbHDBO  uses  a  modi¬ 
fied  Dijkstra’s  algorithm  to  compute  k  non-dominated  paths 
for  each  destination,  using  a  non-linear  weight  function 
w(p)  =  max  ^  WiW  j ,  where  Ci  is  the  constraint  on  metric 
Wi .  For  HbHDBO  to  work  correctly,  global  network  state 
is  required  at  each  node,  and  routing  constraints  must  also 
be  known  a  priori.  However,  in  the  worst  case,  k  can  grow 
exponentially  large;  and  the  performance  of  HbHDBO  also 
varies  with  the  number  of  routing  constraints. 

Sobrinho  uses  an  algebraic  approach  and  investigates  the 
path  optimization  problem  in  the  context  of  Hop-by-Hop 
QoS  routing[12].  In  Sobrinho’s  algebraic  framework,  rout¬ 
ing  is  separated  into  path  weight  functions  that  define  rout¬ 
ing  optimization  requirements  (e.g.,  widest-shortest  path, 
most-reliable  path),  and  the  algorithms  that  compute  the  op¬ 
timal  paths  based  on  the  aggregated  metric  defined  by  the 
weight  function  being  used.  Sobrinho  establishes  the  al¬ 
gebraic  properties  that  a  path  weight  function  must  have, 
in  order  for  any  routing  algorithm  to  converge  correctly 
(i.e.,  to  give  the  optimal  paths  w.r.t.  the  aggregated  met¬ 
ric).  Though  the  results  obtained  by  Sobrinho  establish  a 
generalized  framework  for  QoS-oriented  path  optimization, 
they  cannot  be  simply  applied  to  constrained  path  optimiza¬ 
tion,  because  paths  are  optimized  only  with  respect  to  the 
path  weight  function,  rather  than  being  computed  to  satisfy 
multiple  constraints. 

It  is  clear  from  the  above  summary  of  related  work  that 
existing  distributed  MCP  algorithms  require  a  consistent 
view  of  global  network  state  at  each  node,  and  some  even 
assume  that  the  distribution  of  arriving  routing  constraints 
is  known,  which  is  not  true  or  hardly  achievable  in  practice. 
On  the  other  hand,  most  proposed  QoS  path  optimization 
algorithms  optimize  routing  based  only  on  an  aggregated 
metric,  and  therefore  cannot  be  applied  to  path  optimization 
subject  to  multiple  constraints. 

In  this  paper,  we  propose,  analyze,  and  validate  the 
multi-constrained  path  optimization  routing  (MPOR)  proto¬ 
col.  Nodes  that  run  MPOR  use  distance  vectors  to  exchange 
route  information  only  amongst  neighbors,  and  do  not  re¬ 
quire  knowing  the  global  network  state  or  the  potential  ar- 


riving  constraints.  MPOR  solves  the  general  fc-constrained 
path  optimization  by  distributively  computing  an  x-optimal 
path  set  (the  first  x  shortest  paths  w.r.t.  the  given  optimiza¬ 
tion  metric)  for  each  destination  in  the  network,  in  such  a 
way  that  feasible  paths  can  be  found  with  a  small  value  of 
x.  Because  multiple  paths  are  maintained  at  each  node,  as 
in  TAMCRA  [10]  and  HbHDBO  [9],  MPOR  also  resolves 
the  multi-constrained  path  (MCP)  selection  simultaneously. 
MPOR  operates  in  line  with  IP  routing  (i.e.,  table-driven, 
hop-by-hop,  and  connection-less),  and  is  able  to  optimize 
routing  w.r.t.  a  singular  metric  (the  case  in  the  conventional 
MCPO),  as  well  as  any  logical  distance  that  considers  mul¬ 
tiple  routing  metrics,  provided  that  the  path  function  being 
used  is  both  monotone  and  isotone1 . 

The  rest  of  this  paper  is  organized  as  follows.  Section 
2  introduces  the  network  model  and  background  knowl¬ 
edge  used  in  our  discussion.  Section  3  describes  the  op¬ 
eration  principles  of  MPOR,  the  ordered  loop-free  condi¬ 
tion  o-LFC,  the  process  of  path  weight  propagation,  and 
the  convergence  property  of  MPOR.  Section  4  presents  the 
complexity  analysis  and  Section  5  presents  extensive  simu¬ 
lation  results  of  how  effectively  MPOR  solves  both  multi- 
constrained  path  selection  and  routing  optimization.  Sec¬ 
tion  6  presents  the  concluding  remarks. 

2  System  model 

We  model  the  network  as  a  directed  graph  G  =  {V,L}, 
where  V  is  the  set  of  nodes  and  L  is  the  set  of  links  inter¬ 
connecting  the  nodes.  N  and  E  are  the  cardinalities  of  V 
and  L ,  i.e.,  N  =  \V\  and  E  =  \L\,  respectively. 

We  assume  that  each  link  {lu,v\u,v  €  V}  is  associ¬ 
ated  with  a  link  weight  vector  w(u,  v)  =  {wi,W2---Wk}, 
in  which  Wj  is  an  individual  weight  component,  i.e.,  a 
single  routing  metric.  Accordingly,  any  path  p  from  a 
source  to  a  destination  can  be  assigned  a  path  weight  vec¬ 
tor  wp  =  {w{,w%...wpk},  where  wf  =  Y,iUiVepw(u’v)' 
if  Wi  is  an  additive  metric  (e.g.,  delay);  or  wp  = 
min(wi(u,v )),  lu,v  €E  P ,  if  Wi  is  a  minimal  metric  (e.g., 
bandwidth)  2. 

The  logical  distance  ( LD )  of  path  p  is  given  by  a  path 
function  fp  based  on  the  weights  of  its  consisting  links. 
In  QoS  routing,  fp  is  usually  used  to  specify  how  the 
routing  should  be  optimized.  In  the  bandwidth-inversion 

'Monotone  means  that  the  logical  distance  of  a  path  cannot  decrease 
when  the  path  is  extended,  and  isotone  means  that  the  order  ^  between  two 
paths  must  be  preserved  when  they  are  prefixed  or  suffixed  by  a  common 
third  path.  Readers  can  refer  to  [13]  for  details. 

2  A  minimal  routing  metric  means  that  its  path  measurement  is  deter¬ 
mined  by  the  minimal  value  of  the  corresponding  metric  of  all  links  in  the 
path;  while  an  additive  or  multiplicative  routing  metric  means  that  its  path 
measurement  equals  to  the  sum  or  product  of  the  corresponding  metric  of 
all  links  along  the  path.  We  do  not  consider  multiplicative  metrics  because 
they  can  be  translated  into  additive  metrics  by  using  logarithm. 


shortest-path,  e.g.,  fp  =  b^jJu,v  €  p,  where 

D(u,v )  is  the  available  bandwidth  of  lu>v,  such  that  the 
shortest  path,  in  term  of  inverted  bandwidth,  is  preferred; 
while  in  the  most-reliable  path  routing,  we  can  define  fp  = 
_  log  (prob(u,  v))  ,  lu,v  €  p,  where  prob(u,  v )  is  the 
reliable  probability  of  lUiV,  such  that  the  most  reliable  path 
is  preferred.  Therefore,  we  call  fp  the  optimization  func¬ 
tion,  and  the  logical  distance  computed  by  fp  the  optimiza¬ 
tion  metric,  given  that  the  path  with  minimal  logical  dis¬ 
tance  is  also  optimal  w.r.t.  the  optimization  requirements 
implied  by  fp.  Note  that  an  optimization  metric  should  not 
be  confused  with  the  an  actual  routing  metric,  which  can  be 
for  instance  bandwidth  or  delay. 

It  is  worth  pointing  out  that  logical  distances  are  not  nec¬ 
essarily  simple  real  numbers.  A  logical  distance  is  a  real 
number  only  if  the  optimization  function  fp  can  be  given 
by  a  close-form  equation,  as  for  the  cases  of  the  bandwidth- 
inversion  shortest  path  (J2i  b(u,v ))>  t^le  most-reliable 
path  (J2iu  v  —  log  (prob(u,  v))),  or  the  aggregated  metric 
used  in  the  Interior  Gateway  Routing  Protocol  (IGRP)  [2]: 
fp  =  L  +  where  k  is  a  positive  constant,  L  and  D 
are  the  path  length  and  capacity,  respectively.  Otherwise, 
a  logical  distance  can  be  a  tuple  consisting  of  the  multiple 
routing  metrics  being  considered.  For  example,  for  widest 
shortest-path  (WSP)  routing,  a  path  with  the  shortest  dis¬ 
tance  (e.g.,  hops)  is  preferred,  and  if  multiple  such  short¬ 
est  paths  exist,  the  one  with  the  maximal  bandwidth  is  pre¬ 
ferred.  For  WSP,  fp  is  defined  by  {^DU}V,min(BU}V)), 
in  which  Du  v  and  Bu  v  are  the  distance  and  bandwidth  of 
each  comprising  link  lu.v  along  the  path.  As  the  result,  to 
compare  the  precedence  between  paths,  only  bandwidth  or 
distance  is  not  enough.  Tuple  <D,  B>  has  to  be  used  as  the 
logical  distance  for  each  path  (D  and  B  are  distance  and 
bandwidth,  respectively),  and  path  p  with  logical  distance 
<D1,  Bl>  is  better  than  path  q  with  <D2.  B 2>,  only  if 

D1  <  D2  V  (D1  =  D2  A  B1  >  B2)  (1) 

Similarly,  in  least-cost  shortest-path  routing  (LCSP),  tuple 
<D,C>  is  used  as  the  logical  distance  for  each  path,  in 
with  D  is  the  distance  and  C  is  the  cost.  Function  fp  is 
defined  by  DU}V,  Cu,v)  over  all  comprising  link  lu,v 
of  a  path.  Path  p  with  <D1,  Cl>  is  preferred  over  path  q 
with  <D2,  C2>,  only  if 

Dl  <  D2  V  (D1  =  D2  A  Cl  <  C2)  (2) 

By  extrapolating  the  real-number  metrics  used  in  conven¬ 
tional  best-effort  routing  to  logical  distances,  it  is  handy  to 
compute  optimal  paths  in  the  context  of  QoS  routing,  pro¬ 
vided  that  a  total  order  properly  exists  amongst  the  logical 
distances  defined  by  the  path  function  fp  being  used,  as  we 
further  discuss  in  the  next  section. 


3  The  Multi- Constrained  Path  Optimization 
Routing  Protocol  (MPOR) 

MPOR  attempts  to  find  the  optimal  path  for  the  optimiza¬ 
tion  metric  defined  by  an  optimization  function  fp,  and  this 
path  must  also  be  feasible  w.r.t.  the  given  constraints,  if 
there  is  any. 

To  achieve  the  optimal  routing  defined  by  fp ,  MPOR 
uses  distance-vector  routing  to  distributively  compute  the 
shortest  path  w.r.t.  the  optimization  metric  calculated  by 
fp.  However,  as  we  discussed  in  Sec.  1,  the  shortest  path 
computed  based  only  on  a  single  aggregated  metric  may 
not  meet  the  multiple  constraints  being  considered.  There¬ 
fore,  MPOR  maintains  an  ^-optimal  path  set  for  each  des¬ 
tination.  A  generalized  loop-free  condition  o-LFC  is  intro¬ 
duced,  which  allows  MPOR  to  choose  any  neighbor  satis¬ 
fying  it  as  the  successor  for  a  destination  without  causing 
routing  loops.  A  path  weight  propagation  and  deduction 
process  is  used  to  keep  track  of  the  raw  weight  wp  of  each 
path  in  the  construction  of  the  x-optimal  path  set,  which  en¬ 
ables  MPOR  to  verify  whether  feasible  paths  can  be  found 
when  a  routing  request  arrives.  Lastly,  we  show  that  the 
convergence  of  MPOR  can  be  ensured  if  the  optimization 
function  fp  being  used  is  both  monotone  and  isotone. 

We  show  through  extensive  simulations  that  satisfying 
routing  success  ratios  can  be  achieved  with  a  small  value  of 
x  (e.g.,  x  =  5),  and  the  feasible  paths  being  found  also  have 
high  probabilities  to  be  optimal  or  near-optimal  w.r.t.  the 
given  fp. 

3.1  Loop-freedom  in  MPOR 

When  computing  the  first  x  shortest  paths  for  a  desti¬ 
nation,  a  node  may  use  multiple  neighbors  as  successors 
to  reach  this  destination.  Hence  care  must  be  taken  to  en¬ 
sure  that  routing  loops  are  not  formed  because  nodes  choose 
their  successors  distributively.  Theorem  3.1  introduces  the 
ordered  loop-free  condition  (o-LFC),  which  is  a  generalized 
loop-free  condition  derived  from  the  source  node  condition 
(SNC)  in  [4],  for  computing  loop-free  x-optimal  path  set  in 
MPOR. 

Let  LDj  denote  the  logical  distance  from  node  i  to  des¬ 
tination  j  as  known  by  node  i.  LD‘k  denotes  the  logical 
distance  LDj  from  node  k,  which  is  a  neighbor  of  node  i, 
to  destination  j,  as  reported  to  node  i  by  node  k.  FLDj 
denotes  the  feasible  logical  distance  (FLD)  of  node  i  for 
destination  j,  which  is  an  estimate  of  the  minimal  logical 
distance  maintained  for  destination  j  by  node  i. 

Theorem  3.1.  ('o-LFC)  If  a  total  order  relation  A,  and  the 
associated  strict  order  A,  can  be  properly  established  on  the 
logical  distances  defined  by  a  given  fp,  then  a  node  i  is  free 
to  choose  any  neighboring  node  k  from  its  neighbor  set  Nl, 


as  the  successor  to  reach  destination  j  without  causing  rout¬ 
ing  loops,  provided  that  the  following  condition  is  satisfied: 

LD)k  A  FLD %  k  G  N*  (3) 

Proof.  For  any  neighbor  k  satisfying  (3),  FLDj  A  FLD''-. 
Therefore,  given  that  all  estimates  are  properly  updated, 
loop-freedom  is  obtained,  because  the  FLD s  of  all  the 
nodes  along  a  path  to  destination  j  are  strictly  ordered  in 
a  decreasing  manner.  Once  a  total  order  can  be  properly 
established  on  the  logical  distances  calculated  by  fp,  the 
formal  proof  of  o-LFC  is  similar  to  that  of  SNC  (see  [4], 
Theorem  1,  pp.  132),  which  is  omitted  here  due  to  space 
limitations.  □ 

A  set  of  logical  distances  D  is  total-ordered  w.r.t.  A  if 
the  following  four  properties  are  satisfied:  (1)  A  is  reflexive, 
i.e.,  a  A  a,  fa  G  D\  (2)  A  is  anti-symmetric,  i.e.,  if  a  A  & 
and  b  A  a,  then  a  =  b;  (3)  A  is  transitive,  i.e.,  if  a  A  b  and 
b  A  c,  then  a  A  c;  and  (4)  for  Va,  b  G  D,  either  a  A  b  or 
&  A  a.  We  use  a  A  &  to  denote  that  a  A  b  while  a  f  b. 

For  example  for  WSP,  if  LD{p)  and  LD(q)  are  the 
logical  distances  of  two  paths  p  and  q,  respectively,  then 
LD{p)  A  LD(q)  only  if  Dp  <  Dq  V  ( Dp  =  Dq  A  Bp  > 
Bq)\  for  LCSP,  LD(p)  A  LD(q)  only  if  Dp  <  Dq\/(DP  = 
Dq  A  Cp  <  Cq). 

When  only  a  single  additive  metric  is  considered,  A  and 
A  reduce  to  the  normal  <  and  <;  and  o-LFC  reduces  to  the 
source  node  condition  (SNC)  in  [4],  which  considers  path 
distances  in  positive  real  numbers  only,  on  which  the  total 
order  <  and  <  are  always  well  defined. 

3.2  Operation  principles  of  MPOR 

A  node  i  that  runs  MPOR  maintains  a  routing  entry  for 
each  destination  j,  which  includes  feasible  logical  distance 
FLDj,  current  logical  distance  LDj  and  Sj  -  the  successor 
set  chosen  for  j.  Node  i  maintains  a  neighbor  table  that 
records  the  logical  distance  LDjk  reported  by  each  node 
k  in  its  neighbor  set  N'  for  each  destination  j;  and  a  link 
table  that  reflects  the  link  state  w(i,  k)  for  each  adjacent 
link  U,k,k  G  IV*. 

Because  every  node  must  run  a  separate  copy  of  MPOR 
and  runs  MPOR  for  each  destination,  we  focus  on  node 
i  running  MPOR  to  compute  the  x-optimal  path  set  for  a 
destination  j.  It  should  be  pointed  out  that  i  may  receive 
and  record  up  to  x  (the  shortest,  the  second  shortest  and 
up  to  the  xth  shortest)  values  of  LDjk  from  each  neighbor 
k:  node  i  also  reports  to  its  neighbors  the  first  x  shortest 
logical  distances  from  itself  to  destination  j,  of  which  the 
minimal  value  is  also  used  as  the  feasible  logical  distance 
FLD'j  of  node  i.  For  the  destination  j,  we  have  LDj  =  0, 
FLDj  =  0,  and  LDjj  =  0,  Vfc  G  Nf  where  0  is  the  zero 
as  defined  by  fp.  When  a  node  is  powered  up,  FLD  is  set 


to  oo,  the  infinity  as  defined  by  fp,  and  all  the  other  entries 
are  set  to  empty.  We  also  assume  that  node  i  knows  the 
state  of  each  outgoing  link  w(i,  k),k  €  N*.  When  node  i 
receives  an  input  event  at  time  t,  it  behaves  in  one  of  three 
possible  ways: 

1.  Node  i  is  idle  and  all  estimates  are  left  unchanged 

2.  Node  i  receives  LDj  from  neighbor  k,  updates  the  es¬ 
timates  LDjk  and  leaves  all  other  estimates  unchanged 

3.  Node  i  updates  its  successors  set  Sj(t)  for  destination 
j  based  on  Eq.  (3),  i.e., 

S}(t)  =  {k\LDjk(t)  -<  FLD)(t),  k  €  iW}  (4) 
and  updates  the  feasible  logical  distance 

FLD){t )  =  min  ( LD)k(t )  ©  ld(i,  k)(t))  (5) 

for  all  LDj  reported  by  each  neighbor  fc,  and  over  all  neigh¬ 
bors  in  N*.  ld(i,k )  is  the  logical  distance  of  the  adjacent 
link  li}k,  and  ©  is  the  binary  operator  defined  by  fp,  which 
is  used  to  combine  two  paths  (or  links)  and  compute  the  log¬ 
ical  distance  of  the  resulting  composite  path.  Node  i  also 
re-computes  the  first  x  shortest  LDj  maintained  for  j ,  and 
sends  neighbors  updates  if  any  change  occurs;  otherwise,  it 
leaves  all  other  estimates  unchanged.  □ 

As  with  the  distributed  Bellman-Ford  (DBF)  algorithm, 
MPOR  uses  distance  vectors  to  communicate  logical  dis¬ 
tances  only  amongst  neighboring  nodes,  and  therefore 
avoids  expensive  routing  overhead  caused  by  disseminating 
link-state  information  throughout  the  network.  However, 
major  differences  exist  between  MPOR  and  DBF.  MPOR 
can  optimize  the  routing  as  defined  by  a  given  optimization 
function  fv,  as  well  as  the  simple  metrics  used  in  conven¬ 
tional  best-effort  routing.  MPOR  maintains  the  first  x  short¬ 
est  paths  for  each  destination,  and  therefore  is  also  able  to 
support  multi-constrained  path  selection;  Lastly,  MPOR  is 
a  loop-free  multipath  QoS  routing  protocol  due  to  the  use  of 
o-LFC  (Theorem  3.1),  which  allows  nodes  to  choose  their 
successors  independently  without  causing  loops. 

3.3  Handling  network  dynamics 

As  long  as  a  node  finds  neighbors  that  satisfy  o-LFC, 
it  can  update  its  routing  table  without  having  to  coordinate 
with  its  neighbors  (Theorem  3.1). 

When  node  i  is  unable  to  find  neighbors  satisfying  o- 
LFC  for  destination  j,  must  increase  FLD'j  in  a  way  that  no 
loops  can  be  created.  MPOR  uses  a  scheme  similar  to  that 
used  by  DUAL  [4]  to  achieve  instantaneous  loop  freedom. 
More  specifically,  diffusing  computations  are  used  to  coor¬ 
dinate  upstream  nodes  in  the  path  for  destination  j,  when 


node  i  detects  the  increase  of  logical  distance  and  needs  to 
raise  its  feasible  logical  distance  for  j,  before  another  set 
of  feasible  successors  can  be  safely  obtained.  Due  to  space 
limitations,  we  omit  the  details  here  and  readers  can  refer  to 
[4]  for  more  details. 

3.4  Deduction  of  path  weight  wp 

For  a  path  p  in  the  x-optimal  path  set  computed  for  des¬ 
tination  j,  besides  the  logical  distance,  its  raw  path  weight 
wp  must  also  be  maintained,  because  we  need  wp  to  ver¬ 
ify  whether  p  can  be  a  feasible  path  when  a  routing  request 
arrives.  To  achieve  this,  MPOR  uses  a  path  weight  prop¬ 
agation  and  deduction  process  to  keep  track  of  wp ,  which 
exploits  the  same  routing  messages  used  for  the  exchange 
of  logical  distances,  and  as  such  incurs  no  more  communi¬ 
cation  overhead. 

More  specifically,  in  MPOR,  the  distance  vector  report¬ 
ing  a  path  p  for  j  by  node  k  is  a  tuple  of  {j,  LDj  ,pWj  }, 
in  which  LDj  and  pwj  =  {pwj  (1),  ...pwj  (m)...pwj  (C)} 
are  the  logical  distance  and  the  associated  path  weight  forp, 
respectively,  and  C  is  the  number  of  constraints.  Provided 
that  pwj  (m)  =  0  for  an  additive  metric  and  pwj  (to)  =  oo 
for  a  minimal  metric,  then  after  receiving  the  distance  vector 
from  neighbor  k  via  adjacent  link  l^k,  whose  link  weight  is 
w(i,k)  =  {wi,  node  i  can  compute  the  cor¬ 

responding  path  weight  for  j  by 

pWj  (to)  +  wm  for  additive  metrics 

min  ( pWj  (to)  ,  wm )  for  minimal  metrics 

(6) 

where  to  =  1, 2...C. 

3.5  Optimization  function  fp  and  conver¬ 
gence  to  optimal  paths 

We  argue  that  the  choice  of  fv  is  policy-oriented  or 
application-oriented  in  practice,  because  there  does  not  ex¬ 
ist  an  absolutely  better  or  best  routing  optimization  met¬ 
ric  for  a  given  network.  Therefore,  the  strategy  adopted 
by  MPOR  is  to  specify  the  properties  that  an  optimization 
function  must  have,  instead  of  specifying  a  specific  fp.  The 
advantage  of  this  approach  is  that,  diversified  routing  opti¬ 
mization  policies  can  be  defined  and  implemented  as  long 
as  fp  is  properly  selected,  and  the  convergence  of  MPOR  is 
also  ensured  simultaneously.  This  is  formally  formulated  in 
the  following  theorem. 

Theorem  3.2.  If  the  fp  being  used  is  both  monotone  and 
isotone,  within  finite  time  after  the  last  link-state  change  oc¬ 
curs  in  the  network,  MPOR  converges  correctly,  i.e.,  main¬ 
tains  the  optimal  path  for  each  destination. 


2 


j 


Figure  1.  Counter  examples  -  when  isotonic¬ 
ity  or  monotonicity  fail 


Proof.  According  to  the  sufficient  and  necessary  algebraic 
conditions  for  routing  convergence  [13]  (Sec.  6.2,  Propo¬ 
sition  3-5),  a  distance  vector  routing  protocol  always  con¬ 
verges  to  optimal  paths  w.r.t.  the  optimization  metric  de¬ 
fined  by  a  given  fp ,  if  and  only  if  fp  is  both  monotone  and 
isotone.  Because  in  essence  MPOR  exploits  distance  vec¬ 
tors  and  computes  the  optimal  logical  distance  for  each  des¬ 
tination  using  Bellman-Ford  iteration  (Eq.  (5)),  the  results 
established  in  [13]  also  hold  for  MPOR.  □ 


The  reason  that  fp  has  to  be  monotone  and  isotone,  for 
MPOR  to  converge  correctly,  can  be  illustrated  by  the  ex¬ 
amples  depicted  in  Figure  1 .  We  assume  that  nodes  used  in 
our  examples  run  a  DBF-like  distance-vector  protocol. 

Unlike  WSP,  shortest-widest  path  (SWP)  routing  at¬ 
tempts  to  find  the  path  having  the  maximal  bandwidth,  and 
the  one  with  shortest  distance  is  selected  if  multiple  such 
paths  are  found  with  the  same  bandwidth.  It  is  easy  to  ver¬ 
ify  that  isotone  is  not  true  in  SWP.  In  Figure  1  (a),  links 
are  labeled  with  (B,D)  where  B  is  the  bandwidth  and  D 
is  the  distance  (in  hops),  respectively.  Node  1  chooses 
node  2  as  the  successor  for  destination  j  because  path 
(1,2,  j)  offers  more  bandwidth  (5M)  than  path  (1,  j)  (2M); 
node  S  has  no  other  choice  but  node  1  as  the  successor 
for  destination  j.  As  a  result,  when  each  node  selects  its 
successor  distributively,  the  path  formed  from  S  to  j  is 
(S',  1, 2,  j)  =<  2 M,  3  >,  which  is  not  optimal  because  path 
(s,  1  ,j)  =<  2M,  2  >  and  <2M,2>A<2M,3>. 

Figure  1  (b)  is  an  example  in  which  the  monotone  prop¬ 
erty  does  not  hold.  Assume  that  link  Zi,2  and  l-2,i  have  nega¬ 
tive  cost  -1,  and  the  fp  used  is  simple  addition  ]T  lc{  where 
lei  is  the  cost  of  every  intermediate  link  in  the  path.  It  is 
easy  to  see  that  the  paths  for  destination  j  at  nodes  1  and 
2  can  oscillate  and  never  converge.  In  this  simple  scenario, 
the  result  is  obvious,  because  DBF  cannot  converge  if  the 
topology  contains  negative  cycles  [3].  More  optimization 
functions  can  be  found  in  [12,  13]. 


4  Complexity  Analysis 

At  node  i,  the  space  complexity  is  0(x\Nz\N  +  xN)  = 
0(x\Nl\N).  where  |JV*|  is  the  number  of  neighbors  of  node 
i,  because  the  main  routing  table  and  each  neighbor  table 
have  0(N )  entries,  and  each  entry  can  keep  up  to  x  routes 
for  each  destination.  The  computation  complexity  is  the 
time  taken  to  process  distance  vectors  regarding  a  same  des¬ 
tination,  which  is  0(x\  JV®  |).  When  only  the  shortest  path  is 
maintained,  then  the  space  and  computation  complexity  re¬ 
duce  to  0(|IV*|IV)  and  0(|JV*|),  respectively,  which  are  the 
same  as  that  of  DBF. 

5  Simulation 

We  implemented  MPOR  in  the  network  simulator  NS- 
2[  1 1]  and  conducted  extensive  simulations  to  test  its  perfor¬ 
mance.  Three  types  of  topologies  are  used  in  our  simula¬ 
tion  experiments:  ANSNET,  Pure-random  graph  and  Wax- 
man  graph.  ANSNET  is  widely  used  by  Chen  and  Nahrst- 
edt  [1]  and  other  researchers  to  study  QoS  routing  algo¬ 
rithms.  In  Pure-random  graphs,  the  existence  of  the  link 
between  any  two  nodes  is  determined  by  a  constant  proba¬ 
bility  {pr  |  0  <  pr  <  1},  while  in  Waxman  graphs,  pr  is  de- 

_ d_ 

fined  as  pr  =  ae  pl  ,  0  <  a,  p  <  1 ,  where  d  is  the  distance 
between  these  two  nodes  and  L  is  the  maximal  inter-nodal 
distance  in  the  topology,  such  that  inter-nodal  distance  is 
also  accounted  for. 

5.1  Finding  feasible  paths 

The  evaluation  metrics  we  used  in  this  case  are  success 
ratio  (SR),  existence  percentage  (EP)  and  competitive  ratio 
(CR),  which  are  introduced  by  Yuan  [14]  and  defined  as 
follows. 


SR  = 


EP  = 


CR  = 


number  of  routing  requests  being  routed 
number  of  total  routing  requests 
number  of  requests  routed  by  exact  algorithm 
number  of  total  routing  requests 
number  of  requests  routed  by  heuristic  algorithm 
number  of  requests  routed  by  exact  algorithm 


(7) 

(8) 

(9) 


EP  actually  equals  the  SR  of  an  exact  algorithm,  and 
indicates  how  difficulty  a  feasible  path  can  be  found  to  meet 
the  given  request  (a  small  EP  means  that  it  is  hard  to  find  a 
feasible  path  for  the  given  constraints);  CR  indicates  how 
well  a  heuristic  algorithm  can  work  in  comparison  to  the 
exact  algorithm  with  the  same  EP. 

1  The  purpose  of  such  configuration  is  to  compare  with  existing  simula¬ 
tion  results  of  MCP  algorithms,  e.g.  in  [6]. 
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Figure  2.  ANSNET  (32  nodes  and  54  links), 
two  constraints,  CR  Vs.  EP  and  x  =  1,2, 3, 5. 
Randomly  chosen  sources  and  destinations 
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Figure  3.  ANSNET  (32  nodes  and  54  links), 
two  constraints,  CR  Vs.  EP  and  x  =  1,2,3. 
Coast-to-coast  sources  and  destinations 


For  all  configurations,  all  link  weight  components  are 
uniformly  distributed  in  (10,20],  except  for  ANSNET  in 
the  case  of  two  constraints,  in  which  the  first  component 
is  uniformly  distributed  in  (0, 50],  while  the  second  is  uni¬ 
formly  distributed  in  (0,200]'.  All  sources  and  destina¬ 
tions  are  randomly  chosen  from  the  networks  and  all  re¬ 
sults  presented  here  are  averaged  over  5000  randomly  gen¬ 
erated  routing  requests,  for  different  ranges  of  routing  con¬ 
straints.  Routing  metrics  being  considered  are  additive  un¬ 
less  specified  otherwise,  because  most  algorithms  proposed 
for  MCP,  and  those  being  used  to  compare  with  MPOR 
in  our  simulations,  only  address  additive  constraints.  The 
fp  used  by  MPOR  is  a  linear  combination  that  considers 
each  link-weight  component  equally,  which  is  defined  by 
fp  —  J2awi,a  =  1/k,  if  there  are  k  constraints.  It  is  easy 
to  verify  that  this  function  is  both  monotone  and  isotone. 

As  the  first  step,  we  study  how  the  performance  of 
MPOR  varies  with  the  size  of  the  optimal  path  set  (i.e., 
the  parameter  x)  maintained  for  each  destination,  using 
ANSNET  as  the  topology.  The  results  are  presented  in 
Fig.  2  and  Fig.  3,  respectively.  Fig.  2  indicates  that  a  3- 
optimal  path  set  for  every  destination  is  sufficient  for  MPOR 
to  achieve  satisfying  competitive  ratios  (no  less  than  98%), 
for  all  ranges  of  constraints  (EP  ranges  from  0.25  to  0.99), 
when  sources  and  destinations  are  randomly  chosen  from 
the  network.  Also  as  shown  by  Fig.  3,  MPOR  performs 
even  better  when  sources  and  destinations  are  chosen  from 
boundary  nodes,  i.e.,  potential  feasible  paths  traverse  from 
coast  to  coast,  because  a  3-optimal  path  set  configuration 
achieves  almost  100%  CRs  for  all  ranges  of  constraints.  We 
also  notice  that  the  CR  of  MPOR  approaches  to  a  saturation 
level  and  cannot  be  improved  anymore  even  by  increasing 


the  value  of  x.  The  main  reason  is  that  the  o-LFC  condition 
has  to  be  satisfied  before  a  neighbor  can  be  selected  into  the 
successor  set,  and  therefore  some  feasible  paths  may  be  ex¬ 
cluded  due  to  the  fp  being  used.  In  the  following,  parameter 
x  =  5  unless  specified  otherwise. 

The  MCP  algorithms  that  we  use  to  compare  with  MPOR 
are  EDFS  [7],  KKT  (Korkmaz,  Rrunz  and  Tragoudas  [6]) 
and  JSP  (a  variation  of  Jaffe’s  algorithm  [5]:  Dijkstra’s 
shortest  path  algorithm  w.r.t.  the  aggregated  link-cost  func¬ 
tion  w(u,  v)  =  ["M"’”)  -(-  ])_  jn  which  C{  is  the  con¬ 

straint  on  routing  metric  Wi .  As  the  baseline,  we  also  im¬ 
plement  an  exact  algorithm,  which  has  exponential  running 
time,  but  can  give  all  feasible  paths  for  a  given  routing  re¬ 
quest.  The  SR  comparisons  of  routing  with  two  constraints 
using  ANSNET,  Pure-random  and  Waxman  graphs  are  pre¬ 
sented  in  Figs.  4  and  5,  respectively.  The  results  of  routing 
with  more  constraints  are  presented  in  Fig.  6. 

JSP  lags  behind  all  the  other  algorithms  in  all  scenar¬ 
ios,  which  further  confirms  that  paths  optimized  w.r.t.  a 
single  aggregated  metric  may  not  be  a  good  approach  for 
constrained  path  selection.  EDFS  outperforms  MPOR  and 
other  algorithms  when  the  constraints  are  tight,  and  per¬ 
forms  worse  when  the  constraints  are  moderate  and  loose, 
for  which  EDFS  has  to  iterate  over  more  exploring  se¬ 
quences  to  achieve  a  better  SR.  Though  both  KKT  and 
MPOR  perform  consistently  and  similarly  well,  MPOR  can 
solve  general  fc-constraincd  MCP  problem,  while  KKT  only 
deals  with  two  constraints  and  its  running  time  is  unpre¬ 
dictable  if  constraints  are  tight  [7].  We  also  observe  that 
the  SR  of  MPOR  is  insensitive  to  the  number  of  constraints 
in  all  ranges  of  constraints  and  for  all  the  topologies  being 
simulated.  Last  but  not  least,  we  point  out  that  all  the  algo- 
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Constraint  and  C2  are  uniformly  distributed,  randomly  chosen  source-destination  pairs 


Figure  4.  ANSNET,  two  constraints,  SR  com¬ 
parison,  X  =  5 
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Figure  6.  ANSNET,  multiple  constraints,  SR 
comparison,  x  =  5 


Figure  5.  Pure-random  (39  nodes  and  75 
links)  and  Waxman  graphs  (40  nodes  and  95 
links),  two  constraints,  SR  comparison,  x  =  5 


rithms  we  use  to  compare  with  MPOR  are  centralized  algo¬ 
rithms  and  require  the  global  network  state  at  every  source 
node,  while  MPOR  is  a  fully  distributed  protocol. 

5.2  Finding  constrained  optimal  paths 

We  investigate  the  2-additive-constraint  widest-path 
(in  terms  of  inverted  bandwidth)  routing  and  2-additive- 
constraint  most-reliable  path  routing,  which  represent  the 
scenarios  in  which  the  metrics  to  be  optimized  are  minimal 
and  multiplicative,  respectively. 

The  challenge  here  is  how  to  communicate  the  band¬ 
width  bw(u,v )  or  reliability  probability  p(u,v )  of  a  link 
lu,v  throughout  the  network  without  using  link-state  broad¬ 
casting.  Our  approach  is  to  define  an  fp  (monotone  and 
isotone)  that  translates  bw(u,v )  or  p(u,v)  into  an  additive 


metric,  and  uses  it  as  the  logical  distance  communicated  by 
distance  vectors.  More  specifically,  for  widest-path  opti¬ 
mization,  we  define  fp  as 


/"  =  £ 


bw(u,v)/ Bv 


■  5  lu,V  E  P 


(10) 


where  Bmax  is  an  estimate  of  the  maximum  bandwidth  over 
all  the  links  in  the  network,  then  bw / Bmax  can  be  thought 
of  as  the  normalized  bandwidth  of  link  lU}V.  For  most- 
reliable  path  optimization,  we  define  fp  as 


F  =  5Z-log(p(u,u))  Ju,v  ep  (11) 

Figure  7  and  Fig.  8  demonstrate  the  probability  distribu¬ 
tion  functions  (PDF)  of  how  a  feasible  path  can  be  found 
within  the  ^-optimal  path  set  constructed  by  MPOR.  First, 
as  presented  by  the  legends  in  Fig.  7  and  Fig.  8,  both  fp 
(10)  and  fp  (11)  achieve  satisfying  competitive  ratio  (CR) 
for  the  given  two  additive  constraints.  The  CR  for  function 
(10)  is  above  94.6%,  and  the  CR  for  function  (11)  is  above 
96.7%,  for  all  ranges  of  existence  percentage  (EP),  which 
varies  between  0.05  and  0.98  (i.e.,  from  tight  constraints 
to  loose  constraints).  Second,  more  than  70%  of  the  feasi¬ 
ble  paths  found  by  MPOR  are  also  the  optimal  paths  w.r.t. 
the  specified  fp,  and  almost  95%  of  the  feasible  paths  can 
be  found  if  we  also  consider  the  second  and  third  shortest 
paths  computed  by  MPOR.  This  indicates  that  the  feasible 
paths  computed  by  MPOR  have  a  high  probability  of  being 
optimal,  or  near-optimal  paths  w.r.t.  the  given  optimization 
metric.  Note  that  in  some  prior  work  [8]  MCPO  is  defined 
as  selecting  the  shortest  path  from  the  set  of  feasible  paths 
only,  which  therefore  may  not  be  globally  optimal  w.r.t.  the 
given  fp.  In  this  case,  it  is  intuitive  that  MPOR  has  an  even 
higher  probability  of  finding  the  constrained  optimal  path. 
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MPOR  is  a  fully  distributed  multi-constrained  routing 
and  path  optimization  protocol  that  exploits  distance  vec¬ 
tor  routing,  and  does  not  require  global  network  state  to  be 
maintained  at  every  node,  or  other  unrealistic  assumptions 
such  as  knowing  the  distribution  of  arriving  constraints  at 
each  node.  MPOR  can  optimize  routing  w.r.t.  any  logi¬ 
cal  distance  computed  by  an  optimization  function  fp,  pro¬ 
vided  that  fp  is  both  monotone  and  isotone. 

In  the  future,  we  are  interested  in  addressing  the  routing 
overhead  incurred  by  diffusing  computations  when  path  dis¬ 
tances  increase  or  link  failures  occur.  We  are  also  interested 
in  using  multiple  fp  for  different  classes  of  traffic  flows, 
which  is  meaningful  in  the  context  of  a  DiffServ  model,  for 
example. 


